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Abstract —This paper investigates the belief propagation de¬ 
coding of spatially-coupled MacKay-Neal (SC-MN) codes over 
erasure channels with memory. We show that SC-MN codes with 
bounded degree universally achieve the symmetric information 
rate (SIR) of arbitrary erasure channels with memory. We mean 
by universality the following sense: the sender does not need 
to know the whole channel statistics but needs to know only 
the SIR, while the receiver estimates the transmitted codewords 
from channel statistics and received words. The proof is based 
on potential function. 

Index Terms —spatially-coupled codes, MacKay-Neal codes, 
LDPC codes, potential function 

I. Introduction 

Felstrom and Zigangirov introduced convolutional LDPC 
codes [1], Later the codes are called spatially-coupled (SC) 
codes. Lentmaier et al. confirmed that regular SC LDPC codes 
achieve excellent BP decoding [2], Kudekar et al. proved 
that SC codes achieve MAP threshold by BP decoding on 
the binary erasure channel (BEC) [3] and binary memoryless 
symmetric channels [4]. 

In [5], Takeuchi et al. introduced potential function to un¬ 
derstand how threshold saturation phenomenon happen. With 
some modifications, Yedla et al. proved threshold saturation 
of spatially-coupled LDPC codes over BEC in [6], [7], 

Kasai et al. introduced SC MacKay-Neal (MN) codes, and 
showed that these codes with finite maximum degree achieve 
capacity of BEC by numerical experiment [8]. Obata et al. [9] 
and Okazaki et al. [10] proved respectively, ( di,d r - 2, d r 
2) SC-MN codes and ( di,d r = 3 ,d g = 3) SC-MN codes 
achieve the capacity of BEC for any di > d r , where each of 
di. d r . d g describes the degree of nodes in the Tanner graph 
of the codes. 

Reliable transmissions over channels with memory are 
practically important, e.g., magnetic recording with ISI and 
Rayleigh fading channel with memory [11]. Pfister and Siegel 
proved that carefully designed irregular LDPC codes can 
achieve the symmetric information rate (SIR) of dicode erasure 
channels (DEC) under joint iterative decoding [12], In [13] 
and [14], it was empirically observed that the BP threshold 


of spatially-couple regular codes achieve the SIR of DEC and 
PR2 channels, respectively, by increasing node degree. 

In this paper, we show that SC-MN codes with bounded 
degree universally achieve the symmetric information rate of 
wide variety of erasure channels with memory. We mean by 
universality the following sense: the sender does not need to 
know the whole channel statistics p(y\x) but needs to know 
only the SIR, while the receiver estimates the transmitted 
codewords from channel statistics and received words. The 
proof is based on the powerful potential function method [5], 
[6], [7], 

II. Background 

A. Generalized Erasure Channel (GEC) 

Denote a channel input and output as x = (x \...., x n ) £ 
(0,1}" and y = (yi,... ,y n ) £ y n , respectively. We assume 
that x £ (0,1}™ is uniformly distributed. Let us assume that 
by introducing some appropriate state nodes g_ = (or,... ,a n ) 
such that 

P(x\y) = J2p(x,a\y), 

G_ 

we can factorize p(x,o\y) so that its factor graph is a tree. By 
Bayes rule, we have p(x,a\y) oc p{y\g_,x)p{a\x)p{x). Con¬ 
sider the APP detector implemented by sum-product algorithm 
to calculate 

(p(xj = 0| y),p{xj = %)) =: (pj( 0),/Zj(l)) 

for j = 1,2We say the channel p(y\x) is a gen¬ 
eralized erasure channel (GEC) if (pj(0),pj(l)) is one of 
{(1, 0), (0,1), (1/2,1/2)}. The corresponding LLR values are 
+ 00 , —oo and 0. Some authors use 0, 1 and ?, instead. 


B. LDPC codes over GEC 


Next, consider x is uniformly distributed in an LDPC code 

C. In precise. 


P(x) 


i/#C (xeC) 
0 (x </ C) 


Let us denote the factor graph of p{y\g^, x)p(a_\x)p(x) by G. 
We divide G into two subgraphs. One is the factor graph 
of p(y\a, x)p(a\x) and the other is the factor graph of p(x). 
They are corresponding to APP detector and LDPC decoder, 
respectively. Since the message from APP detector to the bit 
nodes is one of AL the messages used in the LDPC decoder 
also takes value in AL 

Consider the density evolution of the BP decoding on G 
in the limit of code length. We define (f>{: r; e) as a function 
which maps the erasure probability of messages from LDPC 
decoder to APP detector via bit nodes x, to the erasure 
probability of messages from APP detector to from LDPC 
decoder cf>(x; e), where e is a parameter which defines the 
channel. From the definition, it follows that c)>(x: e) is non¬ 
decreasing in x G [0,1]. In this paper, we further assume that 
0(x: e) is twice continuously differentiable with x and strictly 
increasing with e G [0,1]. In this setting, the density evolution 
for ( di,d r ) regular LDPC codes over GEC with 4>{x\e) is 
written as follows. 

z<°> = l, 

® (t+1) =0((l-(l-x W )^- 1 ) di ;e) 

where x ^ is the erasure probability of messages from bit 
nodes to parity-check nodes at the t-th decoding round. 

C. Symmetric Information Rate 

SIR /(e) is the mutual information is defined as follows 

J(e) := lim -/(A ; y(e)), 

n—foo fl 

under the existence of limit, where capital letters represent 
random variables. In [15], [16], it is shown that the SIR is 
calculated via cj>(x\ e) as follows. 

/(e) = 1— f <j)(x;e)dx = 1 —$(l;e), 

Jo 

where <I>(;r; e) := f Q 1 <j>(x'\ e)dx'. Let R be the coding rate. 
Define SIR limit as e such that /(e) = R, and denote 
it by e SIR (/?). Uniqueness of e SIR (i?) is again due to the 
assumption that e) is increasing in e. 

D. MacKay-Neal Codes 

( di,d r ,d g ) MN codes are multi-edge type (MET) LDPC 
used over GEC with 4>(x;e) codes [17] defined by pair of 
multi-variables degree distributions (yrt, v) listed below. 

v(x\$(x;e)) = ^-x dl + ^(x 2 3 ; e), g(x) = x dr x 2 3 . 
di 

Here, we slightly extended the definition of degree distribution 
in such a way that the bits corresponding to the term &(x 2 3 ; e) 
are transmitted through the GEC with <j> € . In the case of 
BEC(e), <l>(a;,e) = ex. We define the erasure probability 
message sent from bit nodes along edges of type j at the /-th 


decoding round by x^ ' 1 . The recursion of density evolution of 
MET-LDPC codes on BEC is given by 

(t) = Vj{y {t) \$>{x;e)) (t+i) = _ nj{l -x^) 

Xj ^(i;id«) ’ Vj /H(l) ’ 

where Vj{x\<b{x\e)) := ^u(x;^{x;e)), pj(x) := £rp(x) 

and id* is the identity function id® (at) = x. 

Then, the density evolution of (di,d r ,d g ) MN codes is 

* (0) = 1 , x^ = f(g(x^);e), 

where 

f(x\e):=(xl l - 1 ,(j>{x 2 g \e)) (1) 

g(x) :=(1 - (1 - x\) dr ~ 1 (l - * 2 ) dg , 

l-(l^xi) dr (l-x 2 ) d °- 1 ). (2) 

E. Spatially-Coupled MacKay-Neal Codes 

SC-MN codes of chain length L and of coupling width w 
are defined by the Tanner graph constructed by the following 
process. First, at each section i £ Z, place rM/l bit nodes 
of type 1 and M bits nodes of type 2. Bit nodes of type 1 
and 2 are of degree di and d g , respectively. Next, at each 
section i G 1, place M check nodes of degree d r + d g . Then, 
connect edges uniformly at random so that bit nodes of type 
1 at section i are connected with check nodes at each section 

1 £ [i,..., i+w— 1] with d r M/w edges, and bit nodes of type 

2 at section i are connected with check nodes at each section 
i £ [i,..., i + w — 1] with d g M/w edges. Bits at section 
if: [0,.L — 1]) are shortened. Bits of type 1 and 2 at section 
i £ [0, L 1] are punctured and transmitted, respectively. The 
rate of SC-MN codes R MN (di,d r ,d g ,L,w) is given by 

R MN (di,d r ,d g ,L,w ) 

d r l + tt,-2E“ 0 (l-(^-K,) 
di L 

= \ (L ->• oo). (3) 

F. Vector Admissible System and Potential Function 

In this section, we define vector admissible systems and 
potential functions. 

Definition 1. Define X = [0, l] d , and F : X x [0,1] —> R and 
G : X —>• R as functional satisfying G(0) = 0. Let D be a 
d x d positive diagonal matrix. Consider a general recursion 
defined by 

* (/+1) = /(fl(* W );e) (4) 

where / : X x [0,1] —> X and g : X -x X are defined 
by F'(x: e) = f(x;e)D and G'(x) = g(x)D , where 
F '{x-,e) = (^f^,---,^f i )- Then the pair (f,g) defines 
a vector admissible system if 

1. f. g are twice continuously differentiable, 

2. f(x; e ) and g(x) are non-decreasing in x and e with 
respect to G ', 

'We say x X y if Xi < yi for all 1 < / < (1 



III. Proof of Achieving SIR 


3- f{g(0);e) = 0 and F(g(0);e) = 0. 
We say x is a fixed point if x = f(g(x); e). 


Definition 2 ([18, Def. 2]). We define the potential function 
U(x;e) of a vector admissible system (f,g) by 

U(x; e) = g(x)Dx T - G(x) - F{g{x ); e). 

Definition 3 ([18, Def. 7]). Let J’(e) = {x £ A” \ {0} | x = 
f(g(x);e)} be a set of non-zero fixed points for e £ [0,1]. 
The potential threshold e* is defined by 

e* = sup{e e [0,1] | min a . e: r (e) U(x; e) > 0}. 


Let e* be threshold of uncoupled system defined in [18, Def. 
6], For e such that e* < e < e*, we define energy gap AE(e) 
as 

A E(e) = max inf U(x\e'). 
e'G[e,l] x^T{e r ) 

Definition 4 ([18, Def. 9]). For a vector admissible system 
( f,g ), we define the SC system of chain length L and 
coupling width w as 


*<■«> 


1 

w 


w — 1 

£/ 


k—0 



w —1 


3=0 



G = 



i £ {0,. ■ ■ ,L — 1}, 
i£{0,..„L-l}. 


If we define (f,g) as the density evolution for {di,d r ,d g ) 
MN codes in (II-D) and (II-D), the SC system gives the density 
evolution of SC-MN codes with chain length L and coupling 
width w. 

Next theorem asserts that if e < e* then fixed points of SC 
vector system converge towards 0 for sufficiently large w. 


Theorem 1 ([18, Thm. 1]). Consider the constant Kf g 
defined in [18, Lem. 11]. This constant value depends only 
on (f,g). If e < e* and w > (dKf^ g )/(2AE(e)), then the 
SC system of ( f,g ) with chain length L and coupling width 
w has a unique fixed point 0. 


It can be seen that the density evolution (/, g) of (di, d r , d g ) 
MN codes over GEC(0(cc; e)) is a vector admissible system 
by choosing F(x\ e), G(x) and D as below, since this system 
(f,g) satisfies the condition in Definition 1. 


F(x;e) = -fxf 1 + <S>(x d 2 a -,e), 
di 

G(x) = d r x i + d g x 2 + (1 - xi) dr (l - x 2 ) da - 1, 
d r 0 


D = 


0 d„ 


From Definition 2, the potential function U(xi,x 2 ,e) of 
( di,d r ,d g ) MN codes is given by 


U( xi,x 2 ;e)) 

= i - $({i - (i - ^^(i - 

-^{l-(l-x i y- 1 (l- X y} dl 

di 


-(1- X i) dr (l- X2 ) da ■ (l + -^- + 
V 1 — X\ 


dgX 2 \ 

1 — x 2 J 


(5) 


In this section, we will prove that ( di,d r = 2 ,d g = 2) 
and ( di,d r = 3 ,d g = 3) SC-MN codes, for any di > d r , 
achieve the SIR of any GEC. First, we calculate the potential 
threshold e*(di,d r ,d g ) of MN codes, and show that the 
potential threshold equals to the SIR limit e sm (d r /d r ). Then 
we apply Theorem 1 which proves that density evolution of 
SC-MN code has a unique fixed point 0 for e smaller than 
SIR limit e SIR (<i r /<i r ). 

A. Potential Function at Trivial Fixed Point 

Recall the definition of potential threshold e* (di, d r , d g ) 
in Definition 3. We need to investigate the structure of 
F(e) to calculate the potential threshold e*(di,d r ,d g ). The 
density evolution (1) of (di,d r ,d g ) MN codes at fixed point 
(x\, x 2 ; cf>{x] e)) can be rewritten as 

xr =(i - (i - x y-\i - X2 ) d °) d '-\ (6) 

xi =</>({! - (1 - Xi) dr (l - at 2 ) ds_1 } dff ; e) 

• {1 — (1 — 2 q) dr (l — x 2 ) d ' 9 ~ 1 } d9 ~ 1 . (7) 

First, observe that (xi = 1,X2 = ^>(l;e)) £ F(e) for e £ 
[0,1]. We call these fixed points trivial. From (II-F) and the 
definition of SIR limit, the next lemma asserts that the sign of 
U(l, 4>[\\ e); e) changes at the SIR limit e SIR (^)- 

Lemma 1. 

C7(l,^(l;e);e) = l-^-$(l ; e), 

f> 0 if e <*“*($), 

C7(l,0(l;e);e) ^ = 0 if e = e SIR (f), (8) 

[ < 0 if e > e SIR (^) • 

Proof: The first part is straightforward from (II-F). The second 
part is obvious from the definition of SIR limit. □ 

B. Potential Function at Non-Trivial Fixed Point 

Next, for given x\ £ (0,1), solve (III-A) in terms of x 2 . 
Denote this by X 2 [xi]. 

Note that for some x\, X 2 [xi] may fall outside [0,1] as one 
can see from Fig. 2. Such points are excluded from the set of 
fixed points. Then it follows that 

{x-i,x 2 [xi}) £F{e[x i]) iff (x 2 [xi],e[xi]) S [0, l] 2 , (9) 

where e[xf\ is the unique solution of the equation (III-A) with 
x 2 = x 2 [xi] holds. In precise, the equation is as follows. 

* 2 [*i] =f({l ~ (1 ^ Xi) dr (l - x 2 [x{\) da ~ 1 } dg \ e[xi]) 
•{l-(l-xi) dr (l-x 2 [xi])^- 1 }^- 1 . 

Uniqueness is due to the assumption that (f>(x\ e) is strictly 
increasing in e. We call such fixed points (III-B) non-trivial. 




Fig. 1. Potential functions U(xi,X 2 [xi]',e[xi]) at non-trivial fixed points of (4,2,2) MN codes and (6,3,3) MN codes for 3 types of generalized erasure 
channels BEC(e[rri]), DEC(e[:ri]), PR2(e[^i]) and PR3(e[:ri]). 


For example of BEC(e), e B Ec[£i] can be written in an 
explicit form. 

r l _ x 2 [xi] 

e B Ec[^i] • _ (1 _ Xi)dr(1 _ X2 [ Xl ])d g -i}d g -i - (10) 

Obviously, trivial and non-trivial fixed-points cover the set 
J'(e), in precise, J'(e) = J- 't(e) U .F„(e). We denote the set of 
trivial and non-trivial fixed-points respectively by T x {t) and 
^n(e). 

J- t (e) :={(l^(l;e))} 

^n(e) := {(xi,x 2 [xi]) | e[xi] = e,X\ G (0,1)} 

(e) 0 ^(e) is an empty set. 


Let </>[xi] be the unique solution of (III-A) in terms of ff) 
for given xi,x 2 = x 2 [x\] and e = e[x\). 

<t>[xi] ■= - ^\xi\ - --— j . (11) 

(1 — (l - xi) dr (l — x 2 [x\]) d s x ) 9 
Equivalently, we have 

<P[xi] = </>(^[xi];e[a;i]), (12) 


where 

1>[xi] := (1 - (1 - Xi)^(l - x 2 [x 1 ]) d °- 1 ) d9 . (13) 

Note that x’ 2 [xi], <j>[x i] and f[x\] do not depend on the channel 
GEC(</>(-; e)), while e[xi] does. From (III-B) and (III-B), it can 
be seen that 


£bec[xi] = (t>[xi\. (14) 

Substituting Xi,X 2 [xi] and (j)[x i] into (II-F), at non-trivial 
fixed points (xi,X 2 [xi]) G ,F(e[xi]), we have the potential 
function as 


U(x 1 ,x 2 [xi];e[xi]) 

= 1 - ^W[xi];e[xi]) 

- ^{1 - (1 - x 1 ) d '- 1 (l - x 2 [x 1 ]) d «} di 
ai 

-(l-x 1 )^(l-x 2 [x 1 ]) d -(l + -^- 

V 1 — Xi 


(15) 


dgX 2 [x{\ \ 

1 - x 2 [xi]/ ■ 


From [9, Lemma 4] and [10, Lemma 1, Lemma2], we have 
the following lemma. 

Lemma 2. Consider transmissions over BEC(e), i.e., we 
have cj)(x ) = 4>beg{x) = e and f\x i] = e[xi]. Let 
C^bec(®i,x’ 2 [xi]; cbecI^i]) be the potential function of 
( di,d r ,d g ) MN codes at the non-trivial fixed points. For any 
di > d r it holds that 

UBEc{x 1 ,x 2 [x 1 ];e B Ec[xi}) > 0 for xi G (0,1) 
for (dr,d g ) = (2,2) and (3,3). 

Lemma 3. For any GEC(<(>(x; e)), let U(xi,x 2 [xi]-,e[xi]) 
be the potential function at the non-trivial fixed point 
(xi, X 2 [xi]) G F(e\xi}) for x\ G (0,1) as defined in (III-B). 
Then, it holds that 


U(x i,x 2 [xi];e[xi]) >U B ecOg, x 2 [xi]; £bec[xt]). 


Proof. From (III-B), we have (x 2 [xi], e[xi]) G [0, l] 2 . 
From (III-B), we have t/>[xi] G [0, 1]. From this and using 
(III-B) and (III-B), we obtain e B Ec[xi] G [0,1]. This jus¬ 
tifies that (7bec(xt, X 2 [xi]; eBEc[^i]) is well-defined since 
Xi,x 2 [xi],£ B ec[xt] G [0,1]. We have 


U{x i,x 2 [xi];e[xi]) - t/ B ec(xi, x 2 [xi]; e BE c[xi]) 

= £bec[xi] • (1 - (1 - x\) dr {l - x 2 [x 1 ])^- 1 ) d « 

- $((1 - (1 - x 1 ) dr (l - x 2 [x 1 ]) d *- 1 ) d - e[xr]) 

=V[xi] • f>[xi] - $(^[xi]; e[xi]) 


=f[xi] ■ 4>[xi] - / (j)(x'-e[xi])dx' 

J o 


(c) 


(d) 


r0[xi] 




(f>[x i] — <f>(x, e[xi])dx' 

0(V>[xi]; e[xi]) - 4>(x'; e[xi])dx' 



The equality (a) is due to (III-B) and (1). The equality (b) 
is due to (III-B). In (c), we used the fact that tp[x i] does 
















not depend on channel GEC(^>(-; e)). The equality (d) is due 
to (III-B). In (e), we used the fact that (f>{f)[xi\; e[xi]) > 
(j)(x';e[x i]) fora;' £ [0, ^>[ati]] since <j>(x;e) is non-decreasing 
in x. The equality is attained with <j>(x\ e ) = 4>bec { x \ e ) = 
e . □ 

In Fig. 2, we plotted the potential functions at non-trivial 
fixed points of (4,2, 2) MN codes and (6, 3,3) MN codes for 3 
types of generalized erasure channels BEC(e[xi]), DEC(e[xi]) 
and PR2(e[xi]). One can see that the potential function for 
BEC is lower than other curves for any x\ £ (0,1) as claimed 
in Lemma 3. 

C. Potential Threshold Equals to SIR Limit 

Next theorem shows the potential threshold of some MN 
codes is equal to the SIR limit. 

Theorem 2. For any GEC(</>(x; e)), the potential threshold e* 
of ( di , d r , d g ) MN codes is equal to e SIR (^) for any di > d r , 
( d ri d g ) = (2,2) and (3,3). 

Proof: From Lemma 2 and Lemma 3, we have that for any 
x\ £ (0,1) such that e = e[x\} £ [0, e SIR (^)), 

U{xi,x 2 [xi\ 1 e[xi\) > D. (16) 


It follows that 


e* = sup{e £ [0,1] | min U(xi,X 2 ’,e) > 0} 

(xi,x 2 )&tF(e) 

= supie £ [0,1] | min U(x lt X 2 ;e) > 0} 

(n,X2)e/t(e)UJ n (e) 


(a) 


sup{eG [0,e SIR (f)) 


min U(xi,X 2 ',e) > 0} 

(xi,x 2 )etFt(e) { JtF n {e) 


In (a), we used (1). In (b), we used (1) and (III-C). □ 

Define the BP threshold e BP (di,d r ,dg,L,w) as the spre- 
mum value of e such that the SC system with chain length L 
and coupling width w of (di,d r ,d g ) MN codes over GEC(e) 
converges to zero. In precise, e BP (di,d r ,dg,L,w) is 

sup{e £ [0,1] | lim xf = 0 for i = 0,1,..., L — 1}. 

t->-oo 

Then, from (II-E) and Theorem 3 and 1 we have the following 
theorem. 

Theorem 3. For any GEC(f(x', e)), the potential threshold e* 
of ( di , d r , d g ) MN codes is equal to e SIR (^) for any di > d r , 
(d r ,d g ) = (2,2) and (3,3). 

lim lim e BP (di, d r , dg, L,w) = e sm (d r /di), 

w —>oo L—foo 

lim lim R MN (di, d r , d q , L, w) = C f. 

W—KX) L —Kx> di 


IV. Conclusion and Future Work 

We have shown that some SC-MN codes achieve the SIR 
limit of any GEC(</>(x; e)) via potential function. The future 
works include an extension erasure multi-acess channels [19] 
and to more general channels, e.g., PR2 channels with Gaus¬ 
sian noise. 
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In words, some SC-MN codes universally achieve the SIR 
limit of any GEC(^>(x; e)) in the limit of large L and w. 


Appendix 

In Appendix, we give three GECs as example. 




X\ X\ 

Fig. 2. Plot of e \x j] at non-trivial fixed points of (4,2,2) MN codes and (6,3,3) MN codes for 3 types of generalized erasure channels BEC(e[xi]), 
DEC(e[xi]), PR2(e[xi]) and PR3(e[aii]). 


Example 1 (Binary Erasure Channel). For the bi- given as 
nary erasure channel BEC(e) with erasure probability e, 
cj)(x; e), 4>(a;; e), /(e) and e[a"i] are respectively given as 

0BEcO;e) = e, 

$BEc(ai;e) = ex, 

^BEc(e) = 1 — e, 
e[xi] = eBEC^i], 


</>DEc(ic; e) = 
^DEcfe e) = 


4e 2 


(2 — a;(l — e)) 2 
4e 2 


(1-0(2- (l-c)*) : 

2e 2 

InEc(e) = 1 - YTe’ 

e[ati] = cy)ec[xi], 


where cbecI^i] is the unique solution £bec °f the following where cdecI^i] is the unique solution cdec of the following 
equation. equation. 


x 2 [xi} =0bec({1 - (1 - x\) dr {l 


^M^^WbecM) 


x 2 [xi] =</>DEc({l - (1 


*1)^(1 


x 2 [xi]) da 1 }^ 9 ; cdec) 


. {1 -( 1 -x 1 ) d ’-(l-x 2 [x 1 ]) d *- 1 } dg - 1 - 

eBEC^i] can be written in an explicit form (III-B). 

The potential function is given as 

Ubec(xi,x 2 [xr]; e[xi]) (17) 

:= 1 - £ bec [ xi ] • ({1 - (1 - Xl ) d ^l - x 2 [x 1 ]) dg - 1 } dg ) 

- X2 [xi)) d *} dl 
Cil 

-(l-x 1 ) d r(l-x 2 [x 1 )) d ° 

/ d r x 1 d g x 2 [xi] \ 

V 1 — a;i 1 — x 2 [xi]) 


• {1 — (1 — at 1 ) dr (l — x 2 [xi}) dg ~ 1 } dg ~ 1 . 


In the case of DEC(e), eDEC^i] can be written in an explicit 
form. 


£DEc[a;i] := 


(2-^[xi])( 


X2 [x l] 

iji\x 1 ]( dg ~ 1 )/ d e 


1/2 


2 - 


^[.Ti]( 


X2\x{\ 


1/2 


In general, we do not need the explicit form of e[xi] for 
the purpose of this paper. The potential function is given as 
follows. 


Ut>-e,c(x\, x 2 [xi\, e[xi\) 

:= 1 - $dec({ 1 - (1 - ar) dr (l - ^ 2 [a:i]) ds_1 } d9 ;eDEc[a:i]) 


Example 2 (Dicode Erasure Channel). For the dicode erasure 
channel DEC(e) with erasure probability e, the output y G 
{0,1, —1, ?}" for given x G {0,1}" is defined as follows. 

Xj — Xj -1 w.p. 1 — e, 

? w.p. e, 

where xq := 0. cj)(x; e), $(a;; e), /(e) and e[x\] are respectively 


- ^{1 - (1 - - x 2 [ Xl }) d °} dl 

Ui 

- (1 - X!) dr (1 - x 2 [x!]) dg 

(l I drXl I d gX 2 [xi] \ 

V 1 — x\ 1 — a^Dci] / 

Example 3 (Partial Response 2 Channel). For the PR2 
channel PR2(e) with erasure probability e, the output y G 



























{0,1, 2, 3,4, ?}” for given x G {0, l} n is defined as follows. 


Vi = 


Xj + 2Xj-\ + Xj -2 
? 


w.p. 1 — e, 
w.p. e, 


where xo := 0. 0(x; e), $(x; e), /(e) and e[xi] are respectively 
given as 


4e 3 (4 — 4(1 — e)x + (1 — e)x 2 ) 

(4 — 2(1 — e 2 )x — (1 — e)e 2 x 2 ) 2 

... /I 2 - x 

PR 2 {x;e) = 4e(^- 


^PR2(a:;e) = 

$ 


^PR2(e) = 1 — 


4 — 2(1 — e 2 )x — (1 — e)e 2 x 2 - 
2e 3 (e+l) 


e 3 + e 2 + 2 ’ 
4 x l\ = e PR2 [ x l]i 


where epR 2 [xi] is the unique solution epp 2 of the following 
equation. 


x 2 [x\\ =0pr 2 ({1 - (1 -xi) dr (l -x 2 [xi]) d ® 1 } d ®; e P R 2 ) 
•{l-(l-x 1 )^(l-x 2 [x 1 ]) d «- 1 }^- 1 . 


The potential function is given as follows. 


?7pr2(xi,x 2 [xi]; e[xi]) 

:= 1 - 4>pr 2 ({1 - (1 - xi)^(l - x 2 [xi]) dg ~ 1 } dg ; ep R 2 [xi]) 


-^{l-(l-z 1 ) d ’- 1 (l - x 2 [x 1 ]) dg } d ‘ 
cli 

- (1 - X!) dr {1 - x 2 [x 1 ]) dg 
. (i I drXl , dgX 2 \xi} \ 

V 1 — xi 1 — x 2 [xi] / 



